Evaluation of the usability, content, readability and cultural appropriateness of online alcohol and other drugs resources for Aboriginal and Torres Strait Islander Peoples in New South Wales, Australia.

OBJECTIVES: This study aimed to analyse the usability, content, readability and cultural appropriateness of alcohol and other drugs (AODs) resources for Aboriginal and Torres Strait Islander Peoples in New South Wales (NSW), Australia. OUTCOME MEASURES: The content of 30 AOD resources for Aboriginal and Torres Strait Islander Peoples was analysed according to the following criteria: general characteristics; elements of graphical design and written communication; thoroughness and content; readability (Flesch-Kincaid grade level (FKGL), Gunning Fog index (Fog), Simplified Measure of Gobbledygook and Flesch Reading Ease); and cultural appropriateness. RESULTS: Most resources displayed good usability, depicted by the use of headings and subheadings (n=27), superior writing style (n=19), relevant visuals (n=19) and use of colour support (n=30). However, some resources used at least one professional jargon (n=13), and many did not provide any peer-reviewed references (n=22). During content analysis, 12 resources were categorised into the alcohol group and 18 resources in the other drugs group. Impact of alcohol during pregnancy and breast feeding (n=12) was the most common included topics in the resources related to alcohol, while the physical impact of drugs (n=15) was the most discussed topics among the other drugs group. Based on the FKGL readability score, 83% of resources met the recommended reading grade level of 6-8 by NSW Health. Many resources (n=21) met at least half of the cultural appropriateness elements of interest. However, less than one-third were developed in collaboration with the local community (n=9), used local terms (n=5), targeted the local community (n=3), included an Aboriginal voice (n=2) and addressed the underlying cause (n=1). CONCLUSIONS: Many AOD resources are developed specifically for Aboriginal and Torres Strait Islander Peoples, but their usability, content and readability differed, and they were not culturally appropriate for all communities. Development of a standardised protocol for resource development is suggested.

Effects of face masks on language comprehension in bilingual children.

Due to the COVID-19 pandemic, many children receive language input through face coverings. The impact of face coverings for children's abilities to understand language remains unclear. Past research with monolingual children suggests that hearing words through surgical masks does not disrupt word recognition, but hearing words through transparent face shields proves more challenging. In this study, we investigated effects of different face coverings (surgical masks and transparent face shields) on language comprehension in bilingual children. Three-year-old English-Mandarin bilingual children (N = 28) heard familiar words in both English and Mandarin spoken through transparent face shields, surgical masks, and without masks. When tested in English, children recognized words presented without a mask and through a surgical mask, but did not recognize words presented with transparent face shields, replicating past findings with monolingual children. In contrast, when tested in Mandarin, children recognized words presented without a mask, through a surgical mask, and through a transparent face shield. Results are discussed in terms of specific properties of English and Mandarin that may elicit different effects for transparent face shields. Overall, the present findings suggest that face coverings, and in particular, surgical masks do not disrupt spoken word recognition in young bilingual children.

Assessing the Readability of Covid-19 Testing Messages on the Internet.

The COVID-19 pandemic first became evident at the end of 2019, and because of the many unknown aspects of this emerging infectious disease, the internet quickly became a source of information for consumers. It is important for any vital information to be written unambiguously, and at a level that can be understood by all people regardless of education levels. The purpose of this study was to assess the readability of 50 sources of COVID19 testing information online. Only 6 websites out of 50 received an appropriate readability score on more than one assessment. One-sample, one-tailed t-tests (α = 0.05, df = 49) were used to see if the websites with information on COVID-19 testing are being written at appropriate reading levels. The resulting p-values indicate that each p-value recorded is substantially below 0.05, it is very unlikely that websites on this topic are being written at the recommended levels. Even the optimal messages on COVID-19 reflect a confusing and rapidly changing public health crisis, however if messages are kept simple and clear, individuals will have the best possible chance of optimizing behavioral mitigation strategies. These are compelling reasons for informational hosts to take necessary steps to ensure that messages are written in as simple terms as possible. To this end, it is suggested that internet sites dispersing COVID-19 testing information build in text analysis methods for all published messages, particularly those meant to inform best health practices in the time of a pandemic.

Readability and topics of the German Health Web: Exploratory study and text analysis.

BACKGROUND: The internet has become an increasingly important resource for health information, especially for lay people. However, the information found does not necessarily comply with the user's health literacy level. Therefore, it is vital to (1) identify prominent information providers, (2) quantify the readability of written health information, and (3) to analyze how different types of information sources are suited for people with differing health literacy levels. OBJECTIVE: In previous work, we showed the use of a focused crawler to "capture" and describe a large sample of the "German Health Web", which we call the "Sampled German Health Web" (sGHW). It includes health-related web content of the three mostly German speaking countries Germany, Austria, and Switzerland, i.e. country-code top-level domains (ccTLDs) ".de", ".at" and ".ch". Based on the crawled data, we now provide a fully automated readability and vocabulary analysis of a subsample of the sGHW, an analysis of the sGHW's graph structure covering its size, its content providers and a ratio of public to private stakeholders. In addition, we apply Latent Dirichlet Allocation (LDA) to identify topics and themes within the sGHW. METHODS: Important web sites were identified by applying PageRank on the sGHW's graph representation. LDA was used to discover topics within the top-ranked web sites. Next, a computer-based readability and vocabulary analysis was performed on each health-related web page. Flesch Reading Ease (FRE) and the 4th Vienna formula (WSTF) were used to assess the readability. Vocabulary was assessed by a specifically trained Support Vector Machine classifier. RESULTS: In total, n = 14,193,743 health-related web pages were collected during the study period of 370 days. The resulting host-aggregated web graph comprises 231,733 nodes connected via 429,530 edges (network diameter = 25; average path length = 6.804; average degree = 1.854; modularity = 0.723). Among 3000 top-ranked pages (1000 per ccTLD according to PageRank), 18.50%(555/3000) belong to web sites from governmental or public institutions, 18.03% (541/3000) from nonprofit organizations, 54.03% (1621/3000) from private organizations, 4.07% (122/3000) from news agencies, 3.87% (116/3000) from pharmaceutical companies, 0.90% (27/3000) from private bloggers, and 0.60% (18/3000) are from others. LDA identified 50 topics, which we grouped into 11 themes: "Research & Science", "Illness & Injury", "The State", "Healthcare structures", "Diet & Food", "Medical Specialities", "Economy", "Food production", "Health communication", "Family" and "Other". The most prevalent themes were "Research & Science" and "Illness & Injury" accounting for 21.04% and 17.92% of all topics across all ccTLDs and provider types, respectively. Our readability analysis reveals that the majority of the collected web sites is structurally difficult or very difficult to read: 84.63% (2539/3000) scored a WSTF ≥ 12, 89.70% (2691/3000) scored a FRE ≤ 49. Moreover, our vocabulary analysis shows that 44.00% (1320/3000) web sites use vocabulary that is well suited for a lay audience. CONCLUSIONS: We were able to identify major information hubs as well as topics and themes within the sGHW. Results indicate that the readability within the sGHW is low. As a consequence, patients may face barriers, even though the vocabulary used seems appropriate from a medical perspective. In future work, the authors intend to extend their analyses to identify trustworthy health information web sites.

EvidenceMap: a three-level knowledge representation for medical evidence computation and comprehension.

OBJECTIVE: To develop a computable representation for medical evidence and to contribute a gold standard dataset of annotated randomized controlled trial (RCT) abstracts, along with a natural language processing (NLP) pipeline for transforming free-text RCT evidence in PubMed into the structured representation. MATERIALS AND METHODS: Our representation, EvidenceMap, consists of 3 levels of abstraction: Medical Evidence Entity, Proposition and Map, to represent the hierarchical structure of medical evidence composition. Randomly selected RCT abstracts were annotated following EvidenceMap based on the consensus of 2 independent annotators to train an NLP pipeline. Via a user study, we measured how the EvidenceMap improved evidence comprehension and analyzed its representative capacity by comparing the evidence annotation with EvidenceMap representation and without following any specific guidelines. RESULTS: Two corpora including 229 disease-agnostic and 80 COVID-19 RCT abstracts were annotated, yielding 12 725 entities and 1602 propositions. EvidenceMap saves users 51.9% of the time compared to reading raw-text abstracts. Most evidence elements identified during the freeform annotation were successfully represented by EvidenceMap, and users gave the enrollment, study design, and study Results sections mean 5-scale Likert ratings of 4.85, 4.70, and 4.20, respectively. The end-to-end evaluations of the pipeline show that the evidence proposition formulation achieves F1 scores of 0.84 and 0.86 in the adjusted random index score. CONCLUSIONS: EvidenceMap extends the participant, intervention, comparator, and outcome framework into 3 levels of abstraction for transforming free-text evidence from the clinical literature into a computable structure. It can be used as an interoperable format for better evidence retrieval and synthesis and an interpretable representation to efficiently comprehend RCT findings.

Electronic informed consent: effects on enrolment, practical and economic benefits, challenges, and drawbacks-a systematic review of studies within randomized controlled trials.

BACKGROUND: Enrolment is one of the most challenging aspects of conducting clinical trials, preceded by the process of informed consent (IC). Different strategies to improve recruitment in clinical trials have been used, including electronic IC. During COVID-19 pandemic, barriers to enrolment have been evident. Although digital technologies were acknowledged as the future of clinical research and potential advantages were shown for recruitment, electronic informed consent (e-IC) has not yet been globally adopted. The purpose of this review is to investigate the effect of using e-IC on enrolment, practical and economic benefits, challenges, and drawbacks when compared to traditional informed consent, through a systematic review. METHODS: Embase, Global Health Library, Medline, and The Cochrane Library databases were searched. No limit was set for publication date, age, sex, or study design. We included all studies within a randomized controlled trial (RCT), published in English, Chinese or Spanish, evaluating the electronic consent process used in the parent RCT. Studies were included if any of the three components ((i) information provision, (ii) participant's comprehension, (iii) signature) of the IC process was designed as electronic, whether administered remotely or face-to-face. The primary outcome was the rate of enrolment to the parent trial. Secondary outcomes were summarized according to the various findings reported on the use of electronic consent. RESULTS: From a total of 9069 titles, 12 studies were included in the final analysis with a total of 8864 participants. Five studies of high heterogeneity and risk of bias showed mixed results on the efficacy of e-IC on enrolment. Data of included studies suggested e-IC could improve comprehension and recall of study-related information. Meta-analysis could not be conducted due to different study designs and outcome measures and the predominantly qualitative findings. CONCLUSION: Few published studies have investigated the impact of e-IC on enrolment and findings were mixed. e-IC may improve participant's comprehension and recall of information. High-quality studies are needed to evaluate the potential benefit of e-IC to increase clinical trial enrolment. TRIAL REGISTRATION: PROSPERO CRD42021231035 . Registration date: 19-Feb-2021.

Digitalizing the Clinical Research Informed Consent Process: Assessing the Participant Experience in Comparison With Traditional Paper-Based Methods.

PURPOSE: Consent processes are critical for clinical care and research and may benefit from incorporating digital strategies. We compared an electronic informed consent (eIC) option to paper consent across four outcomes: (1) technology burden, (2) protocol comprehension, (3) participant agency (ability to self-advocate), and (4) completion of required document fields. METHODS: We assessed participant experience with eIC processes compared with traditional paper-based consenting using surveys and compared completeness of required fields, over 3 years (2019-2021). Participants who consented to a clinical trial at a large academic cancer center via paper or eIC were invited to either pre-COVID-19 pandemic survey 1 (technology burden) or intrapandemic survey 2 (comprehension and agency). Consent document completeness was assessed via electronic health records. RESULTS: On survey 1, 83% of participants (n = 777) indicated eIC was easy or very easy to use; discomfort with technology overall was not correlated with discomfort using eIC. For survey 2, eIC (n = 262) and paper consenters (n = 193) had similar comprehension scores. All participants responded favorably to at least five of six agency statements; however, eIC generated a higher proportion of positive free-text comments (P < .05), with themes such as thoroughness of the discussion and consenter professionalism. eIC use yielded no completeness errors across 235 consents versus 6.4% for paper (P < .001). CONCLUSION: Our findings suggest that eIC when compared with paper (1) did not increase technology burden, (2) supported comparable comprehension, (3) upheld key elements of participant agency, and (4) increased completion of mandatory consent fields. The results support a broader call for organizations to offer eIC for clinical research discussions to enhance the overall participant experience and increase the completeness of the consent process.

Head turning is an effective cue for gaze following: Evidence from newly sighted individuals, school children and adults.

In referential communication, gaze is often interpreted as a social cue that facilitates comprehension and enables word learning. Here we investigated the degree to which head turning facilitates gaze following. We presented participants with static pictures of a man looking at a target object in a first and third block of trials (pre- and post-intervention), while they saw short videos of the same man turning towards the target in the second block of trials (intervention). In Experiment 1, newly sighted individuals (treated for congenital cataracts; N = 8) benefited from the motion cues, both when comparing their initial performance with static gaze cues to their performance with dynamic head turning, and their performance with static cues before and after the videos. In Experiment 2, neurotypical school children (ages 5-10 years; N = 90) and adults (N = 30) also revealed improved performance with motion cues, although most participants had started to follow the static gaze cues before they saw the videos. Our results confirm that head turning is an effective social cue when interpreting new words, offering new insights for a pathways approach to development.

Knowledge Adaptive Multi-Way Matching Network for Biomedical Named Entity Recognition via Machine Reading Comprehension.

Rapid and effective utilization of biomedical literature is paramount to combat diseases like COVID19. Biomedical named entity recognition (BioNER) is a fundamental task in text mining that can help physicians accelerate knowledge discovery to curb the spread of the COVID-19 epidemic. Recent approaches have shown that casting entity extraction as the machine reading comprehension task can significantly improve model performance. However, two major drawbacks impede higher success in identifying entities (1) ignoring the use of domain knowledge to capture the context beyond sentences and (2) lacking the ability to deeper understand the intent of questions. In this paper, to remedy this, we introduce and explore external domain knowledge which cannot be implicitly learned in text sequence. Previous works have focused more on text sequence and explored little of the domain knowledge. To better incorporate domain knowledge, a multi-way matching reader mechanism is devised to model representations of interaction between sequence, question and knowledge retrieved from Unified Medical Language System (UMLS). Benefiting from these, our model can better understand the intent of questions in complex contexts. Experimental results indicate that incorporating domain knowledge can help to obtain competitive results across 10 BioNER datasets, achieving absolute improvement of up to 2.02% in the f1 score.

Health literacy characteristics of over-the-counter rapid antigen COVID-19 test materials.

BACKGROUND: The United States Food & Drug Administration's emergency authorized use, in December 2020, of over-the-counter (OTC) rapid antigen COVID-19 tests was a pandemic control milestone. OBJECTIVE: To assess health literacy-related characteristics of OTC rapid antigen COVID-19 test materials. METHODS: Between September-December 2021, we identified eleven (n = 11) OTC rapid antigen COVID-19 tests available for purchase in the US. We assessed readability (Flesch Reading Ease and Fernández-Huerta), formatting and layout features of English- and Spanish-language step-by-step OTC rapid antigen COVID-19 test package insert instructions. Video-based step-by-step OTC rapid antigen COVID-19 test instructions were evaluated for understandability and actionability (Patient Education Materials Assessment Tool for Audiovisual Materials [PEMAT-A/V]), overall quality (Global Quality Scale [GQS]) and cultural diversity and inclusiveness. Descriptive analyses were performed using IBM® Statistical Package for the Social Sciences. RESULTS: Nine (81.8%) OTC rapid antigen COVID-19 tests included English-language (≈8th-9th reading grade level) step-by-step instructions, while 4 included Spanish-language (≈10th-12th reading grade level) instructions. On average, instructions were printed on a tabloid sized piece of paper, with text size ranging from 4 to 12 point and including nearly 20 illustrations. English-language step-by-step OTC rapid antigen COVID-19 test video-based instructions (n = 6) ranged from 1:04 to 5:41 min with PEMAT-A/V scores ranging from 80% to 100%. As indicated by GQS scores, English-language videos were of high quality (5 videos scored 5/5; 1 video scored 4/5). One COVID-19 test product manufacturing website included Spanish-language video-based instructions (time = 4:59 min; PEMAT-A/V = 100%; GQS = 5). CONCLUSIONS: OTC COVID-19 test step-by-step instructions-both package inserts and video-based-included features shown to foster patient understanding and facilitate proper use. Moving forward, greater attention needs to be placed on expanding both Spanish-language and video-based OTC COVID-19 test material availability to improve accessibility across diverse populations.

Acceptability of a standalone written leaflet for the National Health Service for England Targeted Lung Health Check Programme: A concurrent, think-aloud study.

BACKGROUND: Many countries are introducing low-dose computed tomography screening programmes for people at high risk of lung cancer. Effective communication strategies that convey risks and benefits, including unfamiliar concepts and outcome probabilities based on population risk, are critical to achieving informed choice and mitigating inequalities in uptake. METHODS: This study investigated the acceptability of an aspect of NHS England's communication strategy in the form of a leaflet that was used to invite and inform eligible adults about the Targeted Lung Health Check (TLHC) programme. Acceptability was assessed in terms of how individuals engaged with, comprehended and responded to the leaflet. Semi-structured, 'think aloud' interviews were conducted remotely with 40 UK screening-naïve current and former smokers (aged 55-73). The verbatim transcripts were analysed thematically using a coding framework based on the Dual Process Theory of cognition. RESULTS: The leaflet helped participants understand the principles and procedures of screening and fostered cautiously favourable intentions. Three themes captured the main results of the data analysis: (1) Response-participants experienced anxiety about screening results and further investigations, but the involvement of specialist healthcare professionals was reassuring; (2) Engagement-participants were rapidly drawn to information about lung cancer prevalence, and benefits of screening, but deliberated slowly about early diagnosis, risks of screening and less familiar symptoms of lung cancer; (3) Comprehension-participants understood the main principles of the TLHC programme, but some were confused by its rationale and eligibility criteria. Radiation risks, abnormal screening results and numerical probabilities of screening outcomes were hard to understand. CONCLUSION: The TLHC information leaflet appeared to be acceptable to the target population. There is scope to improve aspects of comprehension and engagement in ways that would support informed choice as a distributed process in lung cancer screening. PATIENT OR PUBLIC CONTRIBUTION: The insight and perspectives of patient representatives directly informed and improved the design and conduct of this study.

Lasting effects of the COVID-19 pandemic on language processing.

A central question in understanding human language is how people store, access, and comprehend words. The ongoing COVID-19 pandemic presented a natural experiment to investigate whether language comprehension can be changed in a lasting way by external experiences. We leveraged the sudden increase in the frequency of certain words (mask, isolation, lockdown) to investigate the effects of rapid contextual changes on word comprehension, measured over 10 months within the first year of the pandemic. Using the phonemic restoration paradigm, in which listeners are presented with ambiguous auditory input and report which word they hear, we conducted four online experiments with adult participants across the United States (combined N = 899). We find that the pandemic has reshaped language processing for the long term, changing how listeners process speech and what they expect from ambiguous input. These results show that abrupt changes in linguistic exposure can cause enduring changes to the language system.

An exhaustive comprehension of the role of herbal medicines in Pre- and Post-COVID manifestations.

ETHNOPHARMACOLOGICAL RELEVANCE: The coronavirus disease (COVID-19) has relentlessly spread all over the world even after the advent of vaccines. It demands management, treatment, and prevention as well with utmost safety and effectiveness. It is well researched that herbal medicines or natural products have shown promising outcomes to strengthen immunity with antiviral potential against SARS-COV-2. AIM OF THE REVIEW: Our objective is to provide a comprehensive insight into the preventive and therapeutic effects of herbal medicines and products (Ayurvedic) for pre-and post-COVID manifestations. MATERIAL AND METHOD: The database used in the text is collected and compiled from Scopus, PubMed, Nature, Elsevier, Web of Science, bioRxiv, medRxiv, American Chemical Society, and clinicaltrials.gov up to January 2022. Articles from non-academic sources such as websites and news were also retrieved. Exploration of the studies was executed to recognize supplementary publications of research studies and systematic reviews. The keywords, such as "SARS-COV-2, coronavirus, COVID-19, herbal drugs, immunity, herbal immunomodulators, infection, herbal antiviral drugs, and WHO recommendation" were thoroughly searched. Chemical structures were drawn using the software Chemdraw Professional 15.0.0.160 (PerkinElmer Informatics, Inc.). RESULT: A plethora of literature supports that the use of herbal regimens not only strengthen immunity but can also treat SARS-COV-2 infection with minimal side effects. This review summarizes the mechanistic insights into herbal therapy engaging interferons and antibodies to boost the response against SARS-COV-2 infection, several clinical trials, and in silico studies (computational approaches) on selected natural products including, Ashwagandha, Guduchi, Yashtimadhu, Tulsi, etc. as preventive and therapeutic measures against COVID. We have also emphasized the exploitation of herbal medicine-based pharmaceutical products along with perspectives for unseen upcoming alike diseases. CONCLUSION: According to the current state of art and cutting-edge research on herbal medicines have showed a significant promise as modern COVID tools. Since vaccination cannot be purported as a long-term cure for viral infections, herbal/natural medicines can only be considered a viable alternative to current remedies, as conceived from our collected data to unroot recurring viral infections.

Readability, understandability and language accessibility of Swedish websites about the coronavirus disease 2019: a cross-sectional study.

BACKGROUND: The COVID-19 pandemic has caused significant morbidity and mortality. To mitigate its spread, members in the general population were prompted to apply significant behavioral changes. This required an effective dissemination of understandable information accessible for people with a wide range of literacy backgrounds. The aim of this study was to investigate the readability, understandability and language accessibility of Swedish consumer-oriented websites containing information about COVID-19. METHODS: Websites were identified through systematic searches in Google.se (n = 76), and were collected in May 2020 when the pandemic spread started in Sweden. Readability and understandability were assessed with the Readability Index, the Ensuring Quality Information for Patients (EQIP) tool, and the Patient Education Materials Assessment Tool Understandability subscale (PEMAT-PU). RESULTS: The median total sample score for Readability Index was 42.0, with the majority of scores being classified as moderate (n = 30, 39%) or difficult (n = 43, 57%). Median total sample scores were for EQIP 54.0% (IQR = 17.0, Range = 8-75) and for PEMAT-PU 60.0% (IQR = 14.75, Range = 12-87). The majority of the websites did not have any texts or links containing information in an alternative language (n = 58, 76%). CONCLUSIONS: Swedish websites contained information of difficult readability and understandability at the beginning of the coronavirus disease 2019 pandemic, with few providing information available in alternative languages. It is possible that these deficits contributed to the spread and impact of the virus. There is a need for studies investigating methods aiming to enhance the readability, understandability and language accessibility of web-based information at the beginning of an epidemic or pandemic.

A Multimetric Readability Analysis of Online Patient Educational Materials for Submental Fat Reduction.

BACKGROUND: Patients often utilize the Internet to seek information related to their care. This study assesses the readability of online patient educational materials for submental fat reduction. METHODS: Patient educational materials from the 12 most popular websites related to submental fat reduction were downloaded and assessed for readability grade level using 10 unique scales. RESULTS: Analysis of the 12 most popular websites (and corresponding 47 articles) revealed that patient educational materials were written, on average, at an 11th grade reading level. The Flesch Reading Ease score was 48.9 (range 39.8-59.2), representing a "difficult" level of reading. Mean readability grade levels (range 9-13th grade for individual websites) were as follows: Coleman-Liau, 11.1; Flesch-Kincaid, 10.8; FORCAST, 10.8; Fry Graph, 10.1; Gunning Fog, 12.7; New Dale-Chall, 10.1; New Fog Count, 11.8; Simple Measure of Gobbledygook, 11.7; Raygor, 6.7. No website was at the 6th grade reading level for patient educational materials recommended by the American Medical Association and National Institutes of Health. CONCLUSIONS: Online patient educational materials for submental fat reduction are written well above the recommended reading level. Recognition of disparities in health literacy is necessary to enable patients to make informed decisions and become active participants in their own care. LEVEL OF EVIDENCE V: This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors   www.springer.com/00266.

Readability of COVID-19 vaccine information for the general public.

BACKGROUND: More than 130 million individuals in the United States have now received at least one dose of a COVID-19 vaccine. Currently, all adults in the Unites States now have access to one of three COVID-19 vaccines. As part of the vaccination procedure, Emergency Use Authorization (EUA) fact sheets, which contain information regarding the vaccine, are provided. The purpose of this study was to analyze the ease of reading (i.e., readability) of the EUA-approved fact sheets for the vaccines currently available in the United States, the V-Safe adverse event survey script, and the Centers for Disease Control and Prevention (CDC) website information on COVID-19 vaccines designed for the general public in the United States. METHODS: We acquired the Pfizer, Moderna, and Janssen EUA fact sheets, as well as the V-Safe survey script and the CDC website information regarding COVID-19 vaccines. These documents were analyzed for their complexity regarding the following readability factors: average length of paragraphs, sentences, and words; font size and style; use of passive voice; the Gunning-Fog index; the Flesch Reading Ease index; and the Flesch-Kincaid Grade Level index. RESULTS: Only the V-Safe adverse-event survey script met readability standards for adequate comprehension. The mean readability scores of the EUA fact sheets and the CDC website were as follows: Flesch Reading Ease score (44.35 avg); Flesch-Kincaid Grade Level (10.48 avg); and Gunning-Fog index (11.8 avg).These scores indicate that at least a 10th-grade level education would be required to understand these reading materials. CONCLUSION: The average person in the United States would have difficulty understanding the information provided in the EUA fact sheets and CDC COVID-19 vaccine website documents; however, the V-Safe survey was written at an adequate reading level. To ensure that the general public fully understands information regarding COVID-19 vaccines, greater care and effort should be given to the development of simplified information material.

Readability and Comprehension of Printed Patient Education Materials.

Background: Health literacy, a recently determined construct plays an important role in how individuals are able to manage their health. A useful approach for the assessment of health literacy is to measure the comprehension of available patient education materials (PEMs). Objective: We aimed at assessing the usefulness of PEMS available in Hungarian by testing comprehension of selected PEMs in different groups of users. Methods: Comprehension of patient education materials in the domain of healthcare was tested by selecting PEMs and creating questions based on their text in 3 dimensions of health literacy: understand, process/appraise, apply/use. Twenty questions were created that could be answered without pre-existing knowledge by reading the appropriate text taken from PEMs. Comprehension was examined in four groups: laypersons, non-professional healthcare workers, 1st year healthcare students, and 5th year medical students. Readability indices were calculated for the same texts to which questions were created. Results: Laypersons answered <50% of the PEMs-based questions correctly. Non-professional healthcare workers performed better with 57% of right answers but significantly worse than healthcare students or medical students. Those with at least high school qualification (maturity exam) showed significantly higher comprehension compared to those with lower educational attainment. Persons in good or very good health also had significantly better comprehension than those in less favorable health. All readability indices showed that comprehension of the tested PEMs required at least 10 years of schooling or more. Therefore, these PEMS are difficult to understand for persons with less than high school level of education. Conclusion: Rephrasing of the investigated patient educational materials would be recommended so that they better fit the educational attainment of the Hungarian population. Evaluation of the readability and comprehensibility of other PEMs also seems warranted.

Official Websites Providing Information on COVID-19 Vaccination: Readability and Content Analysis.

BACKGROUND: Online information on COVID-19 vaccination may influence people's perception and willingness to be vaccinated. Official websites of vaccination programs have not been systematically assessed before. OBJECTIVE: This study aims to assess and compare the readability and content quality of web-based information on COVID-19 vaccination posted on official/governmental websites. Furthermore, the relationship between evaluated website parameters and country vaccination rates were calculated. METHODS: By referring to an open data set hosted at Our World in Data, the 58 countries/regions with the highest total vaccination count as of July 8, 2021, were identified. Together with the websites from the World Health Organization and European Union, a total of 60 vaccination campaign websites were targeted. The "frequently asked questions" or "questions and answers" section of the websites were evaluated in terms of readability (Flesch Reading Ease score and Flesch-Kincaid Grade Level), quality (Health On the Net Foundation code [HONcode] certification and Quality Evaluation Scoring Tool), and content stating vaccination duration of protection and potential side effects. RESULTS: In terms of readability, the Flesch Reading Ease score of the vaccination frequently asked questions websites ranged between 11.2 and 69.5, with a mean of 40.9 (SD 13.2). Meanwhile, the Flesch-Kincaid Grade Level ranged between 6.5 and 17.6, with a mean of 12.1 (SD 2.8). In terms of quality, only 2 websites were HONcode certified, and the Quality Evaluation Scoring Tool score of the websites ranged between 7 and 20, with a mean of 15.3 (SD 3.1). Half of the websites (25/50) did not present a publication date or date of the last update. Regarding the duration of protection offered by the vaccines, 46% (23/50) of the websites stated that they do not know, and another 40% (20/50) did not address it. Five side effects of the vaccinations were most frequently mentioned, namely, fever/chill (41/50, 82%), various injection site discomfort events (eg, swelling, redness, or pain; 39/50, 78%), headache (36/50, 72%), fatigue (33/50, 66%), and muscle/joint pain (31/50, 62%). CONCLUSIONS: In general, the content quality of most of the evaluated websites was good, but HONcode certification should be considered, content should be written in a more readable manner, and a publication date or date of the last update should be presented.

Assessing How Consumers Interpret and Act on Results From At-Home COVID-19 Self-test Kits: A Randomized Clinical Trial.

IMPORTANCE: The US Food and Drug Administration (FDA) authorized SARS-CoV-2 rapid at-home self-test kits for individuals with and without symptoms. How appropriately users interpret and act on the results of at-home COVID-19 self-tests is unknown. OBJECTIVE: To assess how users of at-home COVID-19 self-test kits interpret and act on results when given instructions authorized by the FDA, instructions based on decision science principles, or no instructions. DESIGN, SETTING, AND PARTICIPANTS: A randomized clinical trial was conducted of 360 adults in the US who were recruited in April 2021 to complete an online survey on their interpretation of at-home COVID-19 self-test results. Participants were given 1 of 3 instruction types and were presented with 1 of 4 risk scenarios. Participants were paid $5 and had a median survey completion time of 8.7 minutes. Data analyses were performed from June to July 2021. INTERVENTION: Participants were randomized to receiving either the FDA-authorized instructions (authorized), the intervention instructions (intervention), or no instructions (control), and to 1 of 4 scenarios: 3 with a high pretest probability of infection (COVID-19 symptoms and/or a close contact with COVID-19) and 1 with low pretest probability (no symptoms and no contact). The intervention instructions were designed using decision science principles. MAIN OUTCOMES AND MEASURES: Proportion of participants in the high pretest probability scenarios choosing to quarantine per federal recommendations and perceived probabilities of infection given a negative or positive COVID-19 test result. A Bonferroni correction accounted for multiple comparisons (3 instruction types × 4 scenarios; α = 0.004). RESULTS: After excluding 22 individuals who completed the survey too quickly, the responses of 338 participants (median [IQR] age, 38 [31 to 48] years; 154 (46%) women; 215 (64%) with a college degree or higher) were included in the study analysis. Given a positive test result, 95% (322 of 338; 95% CI, 0.92 to 0.97) of the total participants appropriately chose to quarantine regardless of which instructions they had received. Given a negative test result, participants in the high pretest probability scenarios were more likely to fail to quarantine appropriately with the authorized instructions (33%) than with the intervention (14%; 95% CI for the 19% difference, 6% to 31%; P = .004) or control (24%; 95% CI for the 9% difference, -4% to 23%; P = .02). In the low pretest probability scenario, the proportion choosing unnecessary quarantine was higher with the authorized instructions (31%) than with the intervention (22%; 95% CI for the 9% difference, -14% to 31%) or control (10%; 95% CI for the 21% difference, 0.5% to 41%)-neither comparison was statistically significant (P = .05 and P = .20 respectively). CONCLUSIONS AND RELEVANCE: The findings of this randomized clinical trial indicate that at-home COVID-19 self-test kit users relying on the authorized instructions may not follow the Centers for Disease Control and Prevention's quarantine recommendations, producing unintended risks and unnecessary disruptions. Redesigned instructions that follow decision science principles may improve compliance. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT04758299.